Skip to content

[CI] GLM-Image testcases#2167

Open
chickeyton wants to merge 43 commits into
vllm-project:mainfrom
chickeyton:glm-image-tests
Open

[CI] GLM-Image testcases#2167
chickeyton wants to merge 43 commits into
vllm-project:mainfrom
chickeyton:glm-image-tests

Conversation

@chickeyton
Copy link
Copy Markdown
Contributor

@chickeyton chickeyton commented Mar 25, 2026

PLEASE FILL IN THE PR DESCRIPTION HERE ENSURING ALL CHECKLIST ITEMS (AT THE BOTTOM) HAVE BEEN CONSIDERED.

Purpose

  1. An answer to [RFC]: L4 e2e tests of diffusion models and diffusion features (continuous maintanance)

Test i2i 1024x1024 image on single card, other features and image sizes will be tested in the later PR after GLM-Image bug #2222 got fixed

  1. Fixed the bug of GLM-Image requires "image" mm data field, but AI server passed "img2img" mm data field

  2. Fixed the bug of KeyError: 'prior_token_image_ids'

Test Plan

cd tests/e2e/online_serving
pytest -s test_glm_image_expansion.py

Test Result

all test passed without failed

============================================================================ 1 passed, 18 warnings in 357.38s (0:05:57) =============================================================================

Essential Elements of an Effective PR Description Checklist
  • The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
  • The test plan. Please provide the test scripts & test commands. Please state the reasons if your codes don't require additional test scripts. For test file guidelines, please check the test style doc
  • The test results. Please paste the results comparison before and after, or the e2e results.
  • (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model. Please run mkdocs serve to sync the documentation editions to ./docs.
  • (Optional) Release notes update. If your change is user-facing, please update the release notes draft.

BEFORE SUBMITTING, PLEASE READ https://github.com/vllm-project/vllm-omni/blob/main/CONTRIBUTING.md (anything written below this line will be removed by GitHub Actions)

Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
@chickeyton chickeyton changed the title Glm image tests glm-Image testcases Mar 25, 2026
@chickeyton chickeyton changed the title glm-Image testcases GLM-Image testcases Mar 25, 2026
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
@Gaohan123 Gaohan123 added this to the v0.18.0 milestone Mar 27, 2026
@Gaohan123 Gaohan123 changed the title GLM-Image testcases [CI] GLM-Image testcases Mar 27, 2026
@Gaohan123 Gaohan123 added the nightly-test label to trigger buildkite nightly test CI label Mar 27, 2026
@Gaohan123 Gaohan123 removed the nightly-test label to trigger buildkite nightly test CI label Mar 27, 2026
@Gaohan123 Gaohan123 added diffusion-x2iat-test label to trigger buildkite x2image + x2audio + x2text series of diffusion models test in nightly CI ready label to trigger buildkite CI labels Apr 30, 2026
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Comment thread tests/e2e/online_serving/test_glm_image_expansion.py Outdated
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
Signed-off-by: chickeyton <ngton2014@gmail.com>
@Gaohan123 Gaohan123 modified the milestones: v0.20.0, v0.22.0 May 9, 2026
@Gaohan123 Gaohan123 removed diffusion-x2iat-test label to trigger buildkite x2image + x2audio + x2text series of diffusion models test in nightly CI ready label to trigger buildkite CI labels May 11, 2026
@hsliuustc0106 hsliuustc0106 added the ready label to trigger buildkite CI label May 28, 2026
_get_diffusion_feature_cases("zai-org/GLM-Image"),
indirect=True,
)
def test_glm_image(omni_server: OmniServer, openai_client: OpenAIClientHandler):
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Currently, this test is not selected by any step in test-nightly.yml. Considering adding this test at the step Diffusion X2I(&A&T) · Function Test with H100 · Single-GPU ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready label to trigger buildkite CI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: GLM-Image tensor size error for 512x512 and 1280x1280 input/output images

6 participants